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[Name of the Document] Specification 
[Title of the Invention] 

METHOD AND APPARATUS FOR DIGITAL WATERMARKING, 
AND STORAGE MEDIUM STORING DITITAL WATERMARK PROCESSING 
5 PROGRAM 
[Claims] 

1. A method for embedding digital watermark 
data in digital data contents by means of quantized 
value, said method comprising the steps of: 
10 inputting a partial data of the digital data 

contents and complexity of the partial data of the 
digital data contents; 

changing data changing amount of the quantization 
within the quantized value according to the complexity 
15 of the partial data of the digital data contents; 
changing the partial data value; and 
outputting the partial data of the digital data 
contents embedded with the digital watermark data. 

20 2. The method as claimed in claim 1, further 

comprising the steps of: 

applying wavelet transform to the partial data of 
the digital data contents; 

filtering the value of the high frequency component 
25 data by means of a threshold value; and 
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calculating a complexity of the partial data of the 
digital information contents from numbers that are above 
the threshold value. 

3. A method for embedding digital watermark 
data in digital data contents, said method comprising 
the steps of : 

inputting a partial data of the digital data 
contents ; 

calculating a changed amount of frequency component 
based on the changed amount of every frequency range by 
means of the changed amount of the every frequency range 
according to editing method of the digital data 
contents ; and 

outputting the partial data of the digital data 
contents embedded in the digital watermark data. 

4 . A method for reading digital watermark data 
from a digital data contents which includes the 

20 watermark, said method comprising the steps of: 

inputting the partial data of the digital data 
contents which includes the watermark; and 

reading and outputting the digital watermark data 
from the frequency component based on the changed amount 
25 of every frequency range by use of the changed amount of 



10 
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the every frequency range according to an editing method 
of the digital data contents. 

5 . A method for converting digital data 
5 contents to frequency component and perform digital 

watermark processing to the frequency component, said 

method comprising the steps of: 

inputting the second partial data which* edit one or 

more digital data contents by means of the first partial 
10 data of one or more digital data contents and the 

expected editing method of the digital data contents, 
transforming said first partial data and said 

second partial data into the frequency component by 

applying orthogonal transform which is used when 
15 applying the digital watermark processing to the digital 

data contents; 

calculating a standard deviation of distribution of 

said difference values of the data of every first and 

second frequency component; and 
20 applying the digital watermark by multiplying a 

watermark embedding strength as the changed amount of 

each frequency component. 

6. The method for embedding digital watermark 
25 data as claimed in claim 1, further comprising the steps 
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of : 

calculating quantized value, which is used for the 
digital watermark embedding, by means of the changed 
amount of every frequency range according to the editing 
5 method of the digital data contents; and 

changing the partial data value based on said value 
and the complexity of the partial data. 

7 . An apparatus for embedding digital 

10 watermark data in digital data contents, said apparatus 
comprising : 

a function for inputting a partial data of the 
digital data contents and complexity of the partial data 
of the digital data contents ; 
15 a function for changing data changing amount of the 

quantization within the quantized value according to the 
complexity of the partial data of the digital data 
contents ; 

a function for changing the partial data value; and 
20 a function for outputting the partial data of the 

digital data contents embedded with the digital 
watermark data . 

8. The apparatus for embedding digital 
25 watermark data, said apparatus further comprising: 
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a function for applying wavelet transform to the 
partial data of the digital data contents; 

a function for filtering the value of the high 
frequency component data by means of a threshold value; 
5 and 

a function for calculating a complexity of the 
partial data of the digital information contents from 
numbers that are above the threshold value. 

9 . The apparatus for embedding digital 
watermark data in the digital data contents , said 
apparatus further comprising: 

a function for inputting a partial data of the 
digital data contents; 

a function for calculating a changed amount of 
frequency component based on the changed amount of every 
frequency range by means of the changed amount of the 
every frequency range according to editing method of the 
digital data contents; and 

a function for outputting the partial data of the 
digital data contents embedded in the digital watermark 
data . 

10. The apparatus for embedding digital 
25 watermark data in the digital data contents, said 



15 
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apparatus further comprising: 

a function for inputting the partial data of the 
digital data contents which includes the watermark; and 

a function for reading and outputting the digital 
5 watermark data from the frequency component based on the 
changed amount of every frequency range by use of the 
changed amount of the every frequency range according to 
an editing method of the digital data contents. 

10 11. An apparatus for converting digital data 

contents to frequency component and perform digital 
watermark processing to the frequency component, said 
method comprising the steps of: 

a function for inputting the second partial data 

15 which edit one or more digital data contents by means of 
the first partial data of one or more digital data 
contents and the expected editing method of the digital 
data contents , 

a function for transforming said first partial data 

20 and said second partial data into the frequency 

component by applying orthogonal transform which is used 
when applying the digital watermark processing to the 
digital data contents; 

a function for calculating a standard deviation of 

25 distribution of said difference values of the data of 
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every first and second frequency component; and 

a function for applying the digital watermark by 
multiplying a watermark embedding strength as the 
changed amount of each frequency component. 

5 

12. The apparatus for embedding digital 
watermark data in digital data contents as claimed in 
claim 7 , said apparatus further comprising: 

a function for calculating quantized value, which 
10 is used for the digital watermark embedding, by means of 
the changed amount of every frequency range according to 
the editing method of the digital data contents; and 

a function for changing the partial data value 
based on said value and the complexity of the partial 
15 data. 



13 . A computer readable medium storing 
program code for causing a computer system to embed 
digital watermark data in digital data contents, said 
20 computer readable medium comprising: 

a process for inputting a partial data of the 
digital data contents and complexity of the partial data 
of the digital data contents ; 

a process for changing data changing amount of the 
25 quantization within the quantized value according to the 
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complexity of the partial data of the digital data 
contents ; 

a process for changing the partial data value; and 
a process for outputting the partial data of the 
5 digital data contents embedded with the digital 
watermark data. 

14. The computer readable medium as claimed 
in claim 13 further comprising: 

10 a process for inputting the partial data of the 

digital information contents; 

a process for applying wavelet transform to the 
partial data of the digital data contents; 

a process for filtering the value of the high 
15 frequency component data by means of a threshold value; 
and 

a process for calculating a complexity of the 
partial data of the digital information contents from 
numbers that are above the threshold value. 

20 

15. A computer readable medium for embedding 
digital watermark data in the digital data contents, 
said computer readable medium comprising: 

a process for inputting a partial data of the 
25 digital data contents; 



a process for calculating a changed amount of 
frequency component based on the changed amount of every 
frequency range by means of the changed amount of the 
every frequency range according to editing method of the 
5 digital data contents; and 

a process for outputting the partial data of the 
digital data contents embedded in the digital watermark 
data . 

10 16. A computer readable medium for reading 

digital watermark data from the digital data contents, 
said computer readable medium comprising: 

a process for inputting the partial data of the 
digital data contents which includes the watermark; and 

15 a process for reading and outputting the digital 

watermark data from the frequency component based on the 
changed amount of every frequency range by use of the 
changed amount of the every frequency range according to 
an editing method of the digital data contents. 

20 

17. A computer readable medium for converting 
digital data contents to frequency component and perform 
digital watermark processing to the frequency component, 
said method comprising the steps of: 
25 a process for inputting the second partial data 
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which edit one or more digital data contents by means of 
the first partial data of one or more digital data 
contents and the expected editing method of the digital 
data contents, 

5 a process for transforming said first partial data 

and said second partial data into the frequency 
component by applying orthogonal transform which is used 
when applying the digital watermark processing to the 
digital data contents; ■ 

10 a process for calculating a standard deviation of 

distribution of said difference values of the data of 
every first and second frequency component; and 

a process for applying the digital watermark by 
multiplying a watermark embedding strength as the 

15 changed amount of each frequency component. 

18. The computer readable medium as claimed 
in claim 13, further comprising 

a process for calculating quantized value, which is 
20 used for the digital watermark embedding, by means of 

the changed amount of every frequency range according to 
the editing method of the digital data contents; and 

a process for changing the partial data value based 
on said value and the complexity of the partial data. 



25 
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[Detailed Description of the Invention] 
[Field of the Invention] 

The present invention relates to a digital 
watermarking technique for embedding or reading digital 
5 watermark data in digital data contents which represent 
an image or a sound. 
[Prior Art] 

It is easy to replicate or tamper fraudulently 
with multimedia production, and the easiness hinders an 

10 data content provider from sending data. In addition, 
some users may not use the data originated from the 
provider validly. Therefore, copyright protection is 
strongly needed for the multimedia production. The 
digital watermarking technique is effective in realizing 

15 the copyright protection. According to the digital 
watermarking technique, sub-data is embedded in data 
contents without being noticed by a user by utilizing 
redundancy of data such as of an image and a sound. The 
digital watermarking technique is used for protecting a 

20 multimedia copyright by embedding copyright information, 
a user ID and the like as the sub-data in secret, since 
it is difficult to separate the sub-data from the data 
contents . 

Other conventional techniques are proposed in 
25 Japanese patent applications No . 10-150517 , No . 10-2 10427 , 
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No . 10-257300 , or and No . 10-304323 . 
[Object of the Invention] 

The digital watermark method is also called 
data hiding, finger printing steganography , image/sound 
5 deep encryption and the like. 

Elements for determining performance of the 
digital watermarking technique are as follows: 

(1) quality of data contents in which the 
digital watermark is embedded; 
10 (2) durability of the digital watermark which 

is embedded in the data contents when the 
data contents are manipulated; 

(3) safety against intentional erasing of and 
tampering with digital watermark data, 

15 and 

(4) reliability of the digital watermark data 
which is read from the data contents. 

The digital watermarking technique is broadly 
divided into two methods. One method of gives meaning 

20 to a data value by quantizing. For example, by dividing 
a data value by a quantization value and dividing the 
result by 2 , a bit data can be represented by the 
remainder. Another method embeds digital watermark data 
by using a spread spectrum method. 

25 The above-mentioned examples are based on the 



-13- 



former method. In terms of the method, there is a 
problem with respect to the above element (1) in that 
the digital watermark data embedded in the data contents 
may be perceived, or commercial value of the data 
5 contents may be lost by embedding the digital watermark 
data. With respect to the above element (2), the 
digital watermark data which is embedded in the data 
contents may be dissipated even when a general user uses 
the data contents in a normal way. Particularly, it is 

10 a difficult problem to achieve both elements (1) and (2) 
with enough performance in practical use. 

It is an object of the present invention to 
improve quality of watermarked digital data contents and 
to improve durability of digital watermark data against 

15 media processing of the watermarked digital data 
contents . 

[Means to Solve the Problems] 

In order to accomplish quality improvements of 
the data contents embedded with the digital watermark, 

20 the present invention calculates a complexity of data 
based on human perception of each partial data in a 
process for embedding the digital watermark respectively 
to the partial data of the data contents, and changes 
the changed amount of the partial data according to its 

25 values. That is, the present invention realizes the 
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digital watermark by utilizing local data complexity of 
the data contents which can commensurate with human 
perception characteristics . 

Also, in order to accomplish durability of the 
5 digital watermark with regard to the media editing 

process of the data contents embedded with the digital 
watermark, in a processing for embedding the digital 
watermark by changing values of the frequency component, 
the present invention changes the changed amount in 

10 every frequency component to be embedding target. 

Watermark strength matrix is prepared in every frequency 
range, and together with this and the digital watermark 
strength being multiplied will be the frequency 
component changing amount when actually embedding the 

15 digital watermark. With regard to the ratio of the 

changed amount of each of the every frequency range, by 
a usage (contents editing) method of the data contents 
presumed, various original data contents (prepare 
sufficient contents such as images for the images and 

20 audios for the audios) are edited, distribution of the 
changed amount of the frequency component of before and 
after the editing took place is determined with each 
coefficient value, and a standard deviation of the 
distribution is used. 

25 According to the above-mentioned inventions, 
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the amount of transformation of frequency coefficients 
is changed and/or the amount of transformation is 
increased or decreased according to the complexity of 
the digital data contents. Therefore, the quality of 
5 the watermarked digital data contents can be improved 
and the durability of digital watermark data against a 
manipulation of the watermarked digital data contents 
can be improved. 

[Embodiments of the Invention] 

10 Embodiment 1 

Fig.l is a block diagram showing input data 
and output data of the digital watermark embedding 
apparatus of the present invention. The digital 
watermark embedding apparatus 10 inputs digital data 

15 contents 103 such as an image and a sound as main data, 
key data 12 and digital watermark data 101 as sub-data. 
The digital watermark embedding apparatus 10 embeds 
digital watermark data 101 into the digital data 
contents 103 and outputs watermarked digital data 

20 contents 104. 

Fig. 2 is a block diagram showing input data 
and output data of the digital watermark reading 
apparatus of the present invention. The digital 
watermark reading apparatus 20 inputs the watermarked 

25 digital data contents 21 and the key data 22, and 
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outputs digital watermark data 23 embedded in the 
watermarked digital data contents 21. Here, the key 
data 22 is the same as the key data 12. 

In the following, embodiments of the present 
5 invention will be described. 

[First Embodiment] 

This embodiment is a method for embedding 
digital watermark data in digital data contents by means 
of quantized value, said method comprising the steps of: 
10 inputting a partial data of the digital data 

contents and complexity of the partial data of the 
digital data contents; 

changing data changing amount of the quantization 
within the quantized value according to the complexity 
15 of the partial data of the digital data contents; 
changing the partial data value; and 
outputting the partial data of the digital data 
contents embedded with the digital watermark data. 

First, digital watermark embedding method 
20 based on quantization will be described, and then the 
improvement of the embodiment is described. 

Fig. 3 is a flowchart showing the process of 
the prior art. 

The digital watermark embedding apparatus 10 
25 obtains block data 109 by dividing digital data contents 
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103 into a plurality of blocks (m blocks in this 
example) in step 100. Then, a frequency coefficient 
matrix 115 (an orthogonal transform coefficient matrix) 
is generated by performing an orthogonal transform on 
5 the block data 108 in step 110. A pseudo-random sequence 
125 is generated from input key data 12 in step 120. 
Then, a coefficient (for each block) from the 
coefficient matrix 115 is selected one by one using the 
pseudo-random sequence 125 so as to generate a frequency 

10 coefficient sequence 135 to be watermarked in step 130. 
Each bit of the digital watermark data 101 are diffused 
by repeating number (t) of embedding so that a digital 
watermark sequence 145 is generated in step 140. The 
digital watermark sequence 145 is embedded into the 

15 frequency coefficient sequence 135 such that a 

watermarked frequency coefficient sequence 155 is 
generated in step 150. After that, the frequency 
coefficient sequence 135 in the frequency coefficient 
matrix 115 is replaced by the watermarked frequency 

20 coefficient sequence 155 to generate a watermarked 

frequency coefficient matrix 165 in step 160. Then, the 
watermarked frequency coefficient matrix 165 is inverse- 
orthogonal-transformed to form a watermarked block data 
175 in step 170. After that, the block data part of the 

25 input digital data contents 103 is replaced by the 
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10 



15 



watermarked block data 175 in step 180. As a result, a 
watermarked digital data contents is output. 

In the following, the watermark embedding 
process (step 150) will be described in detail with 
reference to a flowchart shown in Fig. 4. 

Let the repeating number t of each bit of the 



digital watermark data be t = 



m 
n 



, the frequency sequence 



be w[j] ,s[j] [k] ^{0,1} {0^j<n, 0^k<t} . 

The watermark embedding process to the 
frequency sequence {f[i]} is carried out as follows 
1. Following steps are carried out for all i 



( 0 < i < 



m 
n 



n) . 



2. A watermarked frequency coefficient f'[i] is 
obtained from the frequency coefficient f[i] according 
to following steps. 



i) If 



/fl + I 
. 9 2 



mod2 is equal to s[X][Y], 



f ' [i] 



. 9 2 . 



xq 



ii) If 

/Mi 



L 9 2 . 



L 9 



is equal to 



mod2 is different from s[X][Y] and 

m 



L 9 
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f ' [i] 



iii) If 



/[<V 




L i 2 J 





mod2 is different from s [X] [Y] and 



L 9 2 . 



is different from 



L ? . 



f ' [i] 



. 1 2 



5 Here, X=i/t and Y = imodt. In addition, \x] represents a 
maximum number which does not exceed x and x mod y 
represents the remainder of x divided by y. 

Fig. 5 shows the concept of the conventional 
watermark embedding process. As shown in the figure, 

10 digital watermark data is embedded by changing a data 
value of watermarking area to a central value of the 
quantization width . 

Fig. 9 is a flowchart of the whole process of 
the first embodiment. In Fig. 9, a step 190 which 

15 calculates the complexity and a watermark embedding 

process for varying the transformation amount according 
to the complexity (steps 195, 150) are different from 
the conventional process shown in Fig. 2. Therefore, the 
different point will be mainly described in the 

20 following. 

Block data 105 is input, and a complexity 
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sequence 195 is generated by calculating a data 
complexity e [ i ] ( 0 ^ e [ i ] ^ 1 ) for each block data in step 
190. Then, the coefficient value of data to be 
watermarked is transformed to a value within 
quantization width according to the data complexity. In 
this embodiment, it is possible to use a conventional 
method for calculating the data complexity. For example, 
in the case of an image, a process for obtaining local 
image complexity can be used. In this case, it is 
necessary to normalize the range of the local complexity 
such that the range becomes from 0 to 1 , if the range is 
from -a to + J3 . 

Next, the watermark embedding process which is 
the heart of the second embodiment will be described in 
detail. Fig. 7 is a flowchart showing the watermark 
embedding process (step 150) in detail. 

The process for embedding digital watermark 
data into a frequency coefficient sequence {f[i]} of the 
first embodiment is carried out as follows. 

-n) , the following process is 
carried out . 

2. A watermarked coefficient f'[i] is obtained from 
a coefficient f [i] . 



1. For all i (0</< 



m 
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i) If 



. 9 2 



f ' [i]«-f [i] + 



mod2 is equal to s [X] [Y] , 
xq-fU] x e[i] 



/H + I 

2 



L 9 



ii) If 



^ 2 



L 9 2 



is equal to 



mod2 is not equal to s[X] [Y] and 



f ' [i] 







IL ^ 2 J 


2 J 



iii) If 



^ 2 



mod2 is not equal to s [X] [Y] and 



/M + I 
^ 2 



f ' [i] 



is not equal to 

"/W + i 

2 



L 9 



/H 



Here, q represents the quantization width for digital 
10 watermark data embedding, X=i/ j , Y=imodt , and [_x] is the 
maximum integer which does not exceed x, and x mod y 
represents the remainder of x divided by y. 

Fig. 8 is conceptual diagrams showing the 
digital watermark embedding process of the first 
15 embodiment. As shown in Fig. 8, a data complexity e[i] (0 
^e[i]^l) is calculated for each block data, then, the 
value of data in which digital watermark data is 
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embedded is transformed to a value within the 
quantization width according to the data complexity. 

Generally, the quality of the watermarked 
digital data contents is a trade-off for the strength of 
5 the digital watermark data. However, according to the 
present invention, both of the quality of the 
watermarked digital data contents and the watermark 
durability can be improved while keeping the quality and 
the durability in balance. That is, digital watermark 

10 data is embedded according to the local data complexity. 
Specifically, digital watermark data is embedded with a 
greater strength in a complex part, and is embedded with 
a weaker strength in a non-complex part. 

The watermarking technique has an embedding 

15 process and a reading process in a pair. However, even 
if the embedding process is modified from the 
conventional process according to the present invention, 
the reading process does not need to be changed from the 
conventional reading process for reading the digital 

20 watermark data which is embedded by the method of the 
present invention . 
[Second Embodiment ] 

In the following, a second embodiment of the 
present invention will be described. The second 

25 embodiment relates to the process for calculating the 
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data complexity (step 190 in Fig. 6). According to the 
second embodiment, the block data is transformed by 
applying Wavelet transform. Then, high frequency 
coefficient data of the wavelet transformed data is 
5 filtered by using a threshold value, and the complexity 
of the block data is calculated from the number of the 
data values which exceed the threshold. 

Fig. 9 is a flowchart of the process for 
calculating the data complexity according to the second 

10 embodiment. Here, let the dimension of a block data 

B[i] be N, and let the size of the block data be M 0 XMr" 
Xm n -i. A following process is performed on each element 
h v o,vi, --,vN-i (0<v u <M u /2 , 0<u<N) of the high frequency 
coefficient matrix H 0 x Hi"* X H N _i of N dimensional wavelet 

15 transformed block data. 
1 . count* - 0 

2. For all (v 0 , vi , *** , v N _i) , a step 3 is carried out (N 
dimensional loop) . 

3. For a threshold A^O which is set beforehand, 

20 If | h v 0 ,vi, , v N _i I^A, count < -count + 1 . Here, I x | 
represents the absolute value of x. 

4. For a threshold T^O which is set beforehand, 

^ „ count 
If counter, e[i]<-1.0. If not, e [i] «- . 

In the process for calculating the data 



-24- 

complexity, for example, if it is assumed that N=2 (an 
image) , the basis of the wavelet transform is the Haar 
basis, M 0 =16 and Mi=16, an experiment shows that values 
of A=4 and T=16 are good for the balance for embedding 
5 digital watermark data without being notified by a human. 

According to the second embodiment, the above- 
mentioned function can be realized by setting the two 
thresholds A and r according to the characteristics of 
the watermarking technique such as the kind of data to 

10 be watermarked, a unit (the size of the block data) , the 
kind of orthogonal transform to be used. By applying 
the above-mentioned function to the watermarking 
technique, it becomes possible to embed digital 
watermark data more appropriately according to 

15 characteristics of individual digital data contents. 
(Third Embodiment) 

In the following, a fourth embodiment of the 
present invention will be described. 

According to the third embodiment, in the 

20 digital watermark embedding process, block data of 

digital data contents is obtained, and a transformation 
amount of frequency coefficient is calculated on the 
basis of a transformation amount for each frequency band 
according to a manipulation method of the digital data 

25 contents. Then, block data of the watermarked digital 
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data contents is generated. 

Let the dimension of a block data B[i] be N 
and the size be Mo x Mi # # * x M N _i . Here, a sequence which 
represents the ratio of transformation width for the 
5 frequency band of each frequency coefficient needs to be 
obtained beforehand by using adequate digital data 
contents before operating a digital watermarking system. 
The calculation method for obtaining q[i] will be 
described in detail in a fifth embodiment later. 

10 Fig. 10 is a flowchart for obtaining the ratio 

of the quantization with for each frequency band. First, 
digital data contents 1000 is input, and block data 1015 
is obtained by dividing the input digital data contents 
into blocks in step 1010. The block data 1015 is 

15 transformed to first frequency coefficient matrices by 
applying the orthogonal transform in step 1020. Next, 
digital data contents 1035 is generated by performing a 
manipulation such as non-reversible compression on the 
digital data contents 1000 in step 1030. Then, block 

20 data 1045 is generated by dividing the digital data 
contents 1035 into blocks in step 1040. Second 
frequency matrices 1055 is generated by applying the 
orthogonal transform to the block data 1015 in step 1055. 
Then, the variance of the distribution of the difference 

25 between each element of the frequency coefficients 
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matrices 1025 and each element of the frequency 
coefficients matrices 1055 is obtained in step 1060. 
Finally, watermark weight ratio data d v 0 , vi , * # * , v N _i 1070 
which represents the ratio of transformation for each 
5 frequency coefficient is obtained. The watermark weight 
ratio data obtained in this way is stored, and it is 
used in a watermark embedding process and a watermark 
reading process as necessary. The quantization width is 
obtained as d v 0 , vi , v N _i X Power which will be described 
10 next. 

Fig. 11 is a flowchart showing the watermark 
embedding process which is the heart of the third 
embodiment of the present invention. Here, the flow of 
the whole process is the same as that shown in Fig. 3 or 
15 Fig. 6. 

Let the watermark weight ratio sequence be 
{dv 0 , vi , , Vn-i) ( 0 =v u <M u , 0 ^u<N) , and let the watermark 
strength be Power (the watermark strength represents 
durability of digital watermark data against 
20 manipulations of watermarked digital data contents.) 

The watermark embedding process of the 
embodiment is carried out as follows. 



1. For all i (0</< 



m 
n 



n) , a following process is 



carried out. 
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2. A quantization width q[i] used when embedding 
digital watermark data into the frequency coefficient 
f[i] is obtained by q [ i ] ^dv 0 , vi v N _i X Power by using an 
element d v 0 ,vi ,"' , v N _i of the watermark weight ratio 
sequence which corresponds to the band of the frequency 
coefficient f [i] (f [i] is a (vo , vi , , v N _i) th component 
of the frequency coefficient matrices) . 

3. The watermarked frequency coefficient f'[i] is 
obtained from the frequency coefficient f [i] in the 
following way. 



i) If 



/W + I 
L*M 2 J 



f ' [i] 



mod2 is equal to s [X] [Y] , 
x qii] . 



ii) If 



/W + l 
L«W 2 



L«W 2 J' 

mod2 is not equal to s [X] [Y] and 



is equal to 



f ' [i] 



L*]J ' 



iii) If 



2 



/Mi 



is not equal to 



mod2 is not equal to s[X][Y] and 

/M 
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Here, X=i/t, Y=i mod t, and [x] is the maximum integer 




which does not exceed x, and x mod y represents the 



remainder of x divided by y. 



5 



(Fourth Embodiment) 



In the following, a fourth embodiment of the 
present invention will be described. 

The fourth embodiment is a watermark reading 
process corresponding to the watermark embedding process 
10 of the third embodiment. According to the fourth 
embodiment, block data of watermarked digital data 
contents is obtained, and digital watermark data is read 
from frequency coefficients on the basis of 
transformation amount for each frequency band according 
15 to a manipulation method of the digital data contents. 

Fig. 12 is a flowchart showing the conventional 
digital watermark reading process based on quantization. 

The digital watermark reading apparatus 20 
obtains watermarked block data 205 by dividing 
20 watermarked digital data contents 105 into a plurality 

of blocks (m blocks in this example) in step 200. Then, 
a frequency coefficient matrix 215 is generated by 
performing an orthogonal transform on the watermarked 
block data 205 in step 210. 
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A pseudo-random sequence 225 is generated from 
input key data 22 in step 220. Then, a coefficient 
value (for each block) of the frequency coefficient 
matrix 215 is selected one by one using the pseudo- 
5 random sequence 225 so as to generate a watermarked 

frequency coefficient sequence 235 in step 230. Then, 
the watermark reading process is performed on the 
watermarked frequency sequence 235 so that a digital 
watermark sequence 245 is read in step 240. Finally, 

10 the original watermark data 107 is output by performing 
statistical processing on the digital watermark data 
sequence in step 250. 

Next, the digital watermark reading process 
(step 240) will be described in detail with reference to 

15 a flowchart in Fig. 13. The process for reading the 
digital watermark sequence from the watermarked 
frequency coefficient sequence {f'[i]} is shown in the 
following . 

1. Following steps are carried out for all 



20 i(0</< 



m 
n 



n) by using a frequency coefficient 



quantization width q. 

2. The digital watermark sequence s [X] [Y] is read 
from the frequency coefficient f'[i]. That is, 
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20 



•MM- 



a 2 



mod 2 



Here , = 



7 - i mod r . 



Fig. 14 is a flowchart showing the watermark 
reading process of the fourth embodiment of the present 
invention. Here, as in the case of the third embodiment, 
let the watermark weight ratio sequence be (dv 0 , vi , *" , v N _ 
x } (0 ^v u <M u , 0 ^u<N) , and let the watermark strength be 
Power (the watermark strength represents durability of 
digital watermark data against manipulations such as 
non-reversible compression to watermarked digital data 
contents . ) 

The process for reading the digital watermark 
data sequence from the watermarked frequency coefficient 
according to the fourth embodiment is carried out as 
follows . 



1. For all i (0</< 



m 
n 



n) , a following process is 



carried out. 

2. A quantization width q[i] used when reading 
digital watermark data from the frequency coefficient 
f ' [i] is obtained by q [ i ] dv 0 , vi , , v N -i x Power by using 
an element dv 0 , vi , , v N _i of the watermark weight ratio 
sequence which corresponds to the band of frequency 
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coefficient f[i] (f[i] is a (v 0 ,vi,-,v N -i) th component of 
the frequency coefficient matrices) . 

3. The digital watermark data sequence s [X] [Y] is 
read from the watermarked frequency coefficient f'[i] in 
the following way. 



s\x\Y]<- 

Here , X = 



mod 2 



and Y = i mod t . 



According to the above-mentioned third and 
fourth embodiment, the watermark embedding strength can 

10 be changed according to the frequency band. 

Specifically, the watermark embedding and reading method 
applicable for a manipulation method becomes possible. 
In the method, according to the amount of change of 
digital data contents from original data for each 

15 frequency band due to manipulation such as non- 
reversible compression, the watermark strength is raised 
to a band when the amount is large, and the watermark 
strength is reduced when the amount is small. 
Accordingly, both of the quality of watermarked digital 

20 data contents and the durability of digital watermark 
data can be improved at a time. 
(Fifth Embodiment) 

In the following, a fifth embodiment of the 
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present invention will be described. According to the 
fifth embodiment, a number of digital data contents 
(images, sounds and the like) are prepared and 
calculation of a watermark strength matrix is carried 
5 out for each frequency band. 

A processing flow of the fifth embodiment is 
the same as that shown in Fig. 10 basically. Here, the 
orthogonal transform process shown in Fig. 10 is the same 
as an orthogonal transform process used for digital 
10 watermarking process. For example, if the orthogonal 
transform used for digital watermarking is discrete 
cosine transformation (DCT) for a 16><16 size, the DCT 
is used, and, if the transformation used for digital 
watermarking is fast Fourier transform (FFT) for an 128 

15 X128 size, the FFT is used. 

Fig. 15 is a flowchart showing the process of 
calculating the watermark strength matrix for each 
frequency band according to the fifth embodiment. 

Here, let the frequency coefficient matrices 
20 be N, the size be M 0 XMi'" Xm n -i , and each of the 

components be xO v o,vi,-,vn-i , xt v o,vi ,-,vn-i (0^v u <M u , 0^u<N). 
The process shown in Fig. 16 is as follows. 
1. For all i (O^Krn), the following steps 2 and 3 are 
performed . 

2 5 2. For all (v 0 , v,, v„_,) = (0, 0, 0)~(AT 0 , Af,, ~.,M N -i) , the 
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process of the following step 3 is performed. 

o v (/) XO — Xt 

° • •^v 0 ,v 1 ,.-.,v A r_ 1 ^^vo.h V^., "**Hb.^.-.V A r_| 

4. For all (v 0 , v,, .... v^_,) = (0, 0, 0)~(Af 0 , A/,, ^^M N _ X ) , the 



following steps 5 and 6 are performed. 



5 



5 . 




4 



V 0 .VI V„_! 




y <"->((» 



-A 




According to the fifth embodiment, it becomes 



possible to set the watermark strength to a level that 
is suitable for each frequency band according to a 

10 manipulation method for digital data contents such as 
non-reversible compression. For example, if the 
watermark strength is Power and the distribution of the 
amount of change of each coefficient value of the 
frequency coefficients after a manipulation can be 

15 approximated by a Laplacian distribution, when digital 
watermark data is read from digital data contents on 
which an assumed manipulation is performed, the rate of 
bit reversal for the extracted digital watermark data 



20 frequency band (e is the natural logarithm) . It is the 
advantage of the present invention to be able to predict 
the rate of bit reversal with the constant formula. In 



Power 



can be made constant ^ 



V2 



regardless of the 
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addition, according to the embodiment of the present 
invention, one of the problem of the conventional method 
that durability of embedded digital watermark data is 
varied according to the position of the frequency 
5 coefficient is solved. That is, the durability of the 
embedded digital watermark data is constant regardless 
of the position of the frequency coefficient (which is 
obvious from the above formula) . The embodiment can be 
applied not only to the watermarking method based on 

10 quantization but also to a watermarking method based on 
the spread spectrum technique. 
(Sixth Embodiment) 

In the following, a sixth embodiment of the 
present invention will be described. According to the 

15 sixth embodiment, the digital watermark embedding 

process is carried out by utilizing the first embodiment 
and the third embodiment in combination. The watermark 
embedding process of the sixth embodiment will be 
described as a modification of the step 150 shown in 

20 Fig. 6. 

According to the sixth embodiment, the process 
for embedding digital watermark data in a frequency 
coefficient sequence {f[i]} is as follows. 



1. For all i (0</< 



m 
n 



n) , the following is 
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performed. 

2. A quantization width q[i] used when embedding 
digital watermark data into the frequency coefficient 
f[i] is obtained by q [ i ] dv 0 , vi v N _i X Power by using an 
element dv 0 , vi , , v N _i of the watermark weight ratio 
sequence which corresponds to the band of the frequency 
coefficient f [i] . 

3. The watermarked coefficient f'[i] is obtained 
from the frequency coefficient f[i] in the following way 



i) If 



Lrf'l 2 J 

f f [i] + 



mod2 is equal to s [X] [Y] , 



n 



U+I xq [i] _/[/] jxrffl . 



ii) If 



M 2 J 



f ' [i] 



is equal to 



mod 2 is not equal to s [X] [Y] and 



iii) If 
/W 1 



.«W 2 . 



+ - 



L*l 2 J 

f ' [i] 



L*] 2 

is not equal to 



mod2 is not equal to s[X][Y] and 

f\f] 



L*M 2 J 2 



Here, X=i/t, Y=i mod t, and [_x] is the maximum integer 
which does not exceed x, and x mod y represents the 
remainder of x divided by y. 

According to the sixth embodiment, both of the 
5 quality of the watermarked digital data contents and the 
durability of digital watermark data can be further 
improved as compared with the first embodiment and the 
third embodiment applied separately. The watermark 
reading method shown in the fourth embodiment can be 
10 used as-is for a watermark reading method in the sixth 
embodiment . 

The above-mentioned processes performed by the 
digital watermark reading apparatus and the digital 
watermark embedding apparatus according to the present 

15 invention can be constructed by a program which can be 

stored in a computer readable medium such as a disk unit, 
a floppy disk, CD-ROM and the like. Then, by installing 
the program into a computer from the medium, the present 
invention can be easily realized. 

20 [Advantages of the Invention] 

As described above, according to the present 
invention, it is possible to change the ratio of the 
changed amount of the frequency component at the time of 
embedding the digital watermark with every frequency 

25 band, and/or to improve quality of watermarked digital 
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data contents and to improve durability of digital 
watermark data against media processing of the 
watermarked digital data contents. 
[Brief Description of the Drawings] 
5 Fig.l is a diagram showing an overview of an 

input/output relationship of the digital watermark 
embedding processing apparatus; 

Fig. 2 is a diagram showing an overview of an 
input/output relationship of the digital watermark 
10 reading processing apparatus; 

Fig. 3 is a flowchart showing a conventional 
digital watermark embedding processing; 

Fig. 4 is a detailed flowchart showing an 
important part of the conventional digital watermark 
15 embedding processing; 

Fig. 5 is a schematic diagram showing a 
conventional digital watermark embedding processing; 

Fig. 6 is an overall flowchart showing a 
digital watermark embedding processing of embodiment 1 
20 of the present invention; 

Fig. 7 is a detailed flowchart showing an 
important part of the digital watermark embedding 
processing of embodiment 1; 

Fig. 8 is schematic diagram showing the digital 
25 watermark embedding processing of embodiment 1; 
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Fig.9 is a processing flowchart of data 
complexity calculation of embodiment 2 of the present 
invention ; 

Fig. 10 is a processing flowchart of the 
5 digital watermark weight ratio sequence used in 
embodiments 3 and 4 of the present invention; 

Fig. 11 is a detailed flowchart of an important 
part of the digital watermark embedding processing of 
embodiment 3 of the present invention; 
10 Fig. 12 is an overall flowchart of the 

conventional digital watermark reading processing; 

Fig. 13 is a detailed flowchart of the 
important part of the conventional digital watermark 
reading processing; 
15 Fig. 14 is a detailed flowchart of the 

important part of the digital watermark reading 
processing of embodiment 4 of the present invention; 

Fig. 15 is a detailed flowchart of the digital 
watermark strength matrix calculation of embodiment 5 of 
20 the present invention. 

[Description of the Reference Numbers] 

10 digital watermark embedding apparatus 

11 data contents 

12 key data 

25 13 digital watermark data 
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14 watermark data contents 

20 digital watermark reading processing apparatus 

21 watermark data contents 

22 key data 

5 23 digital watermark data 



-40- 



[Name of the Document] Abstract 
[Abstract] 

[Object] Object of the present invention to improve 
quality of watermarked digital data contents and to 
5 improve durability of digital watermark data against 
media processing of the watermarked digital data 
contents . 

[Solution Means] The present invention 

calculates a complexity of data based on human 

10 perception of each partial data in a process for 

embedding the digital watermark respectively to the 
partial data of the data contents, and changes the 
changed amount of the partial data according to its 
values. Watermark strength matrix is prepared in every 

15 frequency range, and together with this and the digital 
watermark strength being multiplied will be the 
frequency component changing amount when actually 
embedding the digital watermark. 
[Selected Figure] Fig. 6 
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